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ABSTRACT 



To determine what Federal Student Aid ( FSA) , previously the 
Office of Student Financial Assistance, had done to develop and implement a 
strategic direction as mandated by Congress in performance-based organization 
legislation, the General Accounting Office (GAO) reviewed FSA’s strategic and 
annual performance plans and annual reports, interviewing officials of the 
Department of Education and FSA in headquarters and five regional FSA 
offices. Information from many other sources complemented this study. The 
review shows that the FSA has developed three strategic goals, created 
indicators to measure progress toward those goals, and developed a tool to 
link employees 1 day-to-day activities to the strategic goals. The goals are 
to: (1) increase customer satisfaction; (2) increase employee satisfaction; 

and (3) reduce unit cost. FSA efforts to date are having promising results in 
terms of customer and employee satisfaction, but progress toward reducing 
unit costs is more difficult to gauge. FSA has also begun to implement some 
human capital practices to organize its services better. The GAO recommends 
that the Secretary of Education direct the FSA to make its performance plan 
more useful to congressional decision makers, and that efforts should be made 
to make information more timely and readily available. An appendix contains 
comments from the U.S. Department of Education, and an second appendix 
contains GAO acknowledgments and contacts. (SLD) 
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United States General Accounting Office 
Washington, DC 20548 



April 30, 2002 

The Honorable Edward M. Kennedy 
Chairman 

Committee on Health, Education, Labor, and Pensions 
United States Senate 

The Honorable James M. Jeffords 
United States Senate 

The Department of Education’s Office of Federal Student Aid 1 (FSA) 
administers more than $53 billion in federal financial aid for more than 8.1 
million students. Since 1990, because of concerns about Education’s 
vulnerabilities to losses due to fraud, waste, abuse, and mismanagement, 
GAO has included student financial aid on our high-risk list. 2 To address 
these and other longstanding management weaknesses, Congress 
amended the Higher Education Act in 1998, establishing FSA as a 
performance-based organization (PBO) within the Department of 
Education. A PBO is intended to transform the delivery of public services 
by having the organization commit to achieving specific measurable goals 
with targets for improvement in exchange for being allowed to operate 
without the constraints of certain rules and regulations to achieve these 
targets. As a PBO, FSA specifies how it will achieve these targets through 
its performance plan, which includes its longer-term strategic goals and 
annual performance goals as well as strategies that it will use. In creating 
the PBO, Congress provided FSA, subject to the direction of the secretary 
of education, with more flexibility to manage its operations while requiring 
Education to retain policy-making functions. It has been more than three 
years since Congress created the PBO at FSA. 



1 Financial aid programs are administered by an office previously known as the Office of 
Student Financial Assistance (SFA). The name of SFA was changed to Federal Student Aid 
on March 6, 2002. 

2 U.S. General Accounting Office, High-Risk Series: Student Financial Aid , GAO/HR-95-10 
(Washington, D.C.: Feb. 1, 1995); High-Risk Program: Information on Selected High-Risk 
Areas , GAO/HR-97-30 (Washington, D.C.: May 16, 1997); High-Risk Series: An Update, 
GAO/HR-99-1 (Washington D.C.: Jan. 1, 1999); and High-Risk Series: An Update, 
GAO-01-263 (Washington, D.C.: Jan. 1, 2001). The former Guaranteed Student Loan 
Program, now called the Federal Family Education Loan Program, was included in our 
original 1990 list; in 1995 we revised this designation to include all student financial aid 
programs included in Title IV of the Higher Education Act of 1965 (commonly referred to as 
title IV financial aid or title IV programs). 
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To respond to your interests concerning FSA’s progress since becoming a 
PBO, we focused our review on addressing three questions: 

1. What FSA has done to develop and implement a strategic 
direction — its plan for achieving the goals Congress specified for it in 
the PBO legislation — to accomplish its mission, 

2. What human capital strategies FSA has adopted to ensure that it can 
carry out its mission, and • 

3. What steps Education has taken to clarify FSA’s level of independence 
and its relationship with other Education offices. 

To identify this information, we reviewed FSA’s strategic and annual 
performance plans and annual reports. We interviewed Education and FSA 
officials in headquarters and FSA officials in 5 of its 10 regional offices — 
Atlanta, Chicago, New York, Philadelphia, and San Francisco. We selected 
these regional offices primarily because they oversee the largest number 
of postsecondary institutions and because they oversee a variety of public 
and private institutions. We also met with representatives of the secretary 
of education’s Management Improvement Team. 3 We interviewed experts 
in federal agency/union relationships, higher education associations, an 
official with the U.S. Patent and Trademark Office (also established as a 
PBO), and officials with Education’s Office of Inspector General (IG). We 
used our Human Capital Self-Assessment Checklist 4 and Internal Control 
Management and Evaluation Tool 5 to assist us in reviewing FSA’s actions. 



3 To address many long-standing management challenges facing the department, the 
secretary of Education established a team of senior managers and employees — the 
management improvement team (MIT) — to address short-term management 
recommendations and develop a plan to address longer-term and structural issues. The MIT 
is charged with several responsibilities, most notably to obtain a clean audit opinion from 
the department’s auditors, have GAO’s high-risk designation removed for FSA programs, 
put in place an effective system of internal controls, and provide a structure for measuring 
progress toward solving identified problems. The Blueprint for Management Excellence 
published by the department in October 2001, specifies the department’s plans to address 
these responsibilities. 

4 U.S. General Accounting Office, Human Capital: A Self-Assessment Checklist for Agency 
Leaders, GAO/OCG-00-14G (Washington, D.C.: Sept. 1, 2000). See also U.S. General 
Accounting Office, A Model of Strategic Human Capital Management, GAO-02-373SP 
(Washington, D.C.: March 15, 2002) for our more recent tool intended to help federal 
agency leaders better manage their human capital. 

0 U.S. General Accounting Office, Internal Control Management and Evaluation Tool, 
GAO-01-1008G (Washington, D.C.: Aug. 2001). 

6 



o 



Page 2 



GAO-02-255 Federal Student Aid 



We conducted our work between March 2001 and March 2002 in 
accordance with generally accepted government auditing standards. 



Results in Brief 



To develop and implement a strategic direction — its plan for achieving the 
purposes Congress specified for it in the PBO legislation — FSA has 
developed three strategic goals, created indicators to measure progress 
toward those goals, and developed a tool to link employees’ day-to-day 
activities to these strategic goals. These strategic goals are to (1) increase 
customer satisfaction, (2) increase employee satisfaction, and (3) reduce 
unit cost. FSA’s efforts to date are having promising results in terms of the 
general improvement of customer and employee satisfaction scores. 
Because the indicator FSA uses to measure unit cost has certain 
limitations, such as not measuring actual costs, it is difficult to gauge 
FSA’s progress in reducing unit cost. In addition, FSA’s performance plan, 
which specifies how it will achieve its strategic goals, could be more 
useful to congressional decision makers by specifying how the annual 
goals and strategies it includes in the performance plan will lead to the 
integration of FSA’s financial aid systems and help ensure program 
integrity — explicit objectives of Congress in establishing FSA as a PBO. 
For example, in its performance plan FSA includes technical assistance 
projects — such as holding conferences to explain rules and regulations to 
schools participating in financial aid programs. However, FSA does not 
make clear how it will know whether compliance with rules and 
regulations has improved as a result of such projects, thus enhancing 
program integrity. Further, while the PBO legislation requires the PBO to 
submit, through the secretary, to Congress an annual report on the 
performance of FSA, the fiscal year 2000 report was prepared by FSA and 
submitted to the secretary, but was not submitted to Congress. Like the 
fiscal year 1999 report, the fiscal year 2000 report did not include all the 
information specified by the legislation. FSA has not yet submitted the 
fiscal year 2001 annual report to the secretary. 

FSA has begun to implement some human capital practices to better 
organize its services and manage its employees, but gaps exist in its 
human capital strategy and it has not yet implemented performance 
management initiatives to develop and assess its employees. To better 
serve customers, FSA reorganized on the basis of the customer groups it 
serves — students, schools, and financial partners (lenders and guaranty 
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agencies). 0 In addition, FSA has implemented some practices to ensure the 
accountability of its senior leadership and to encourage accountability 
throughout the organization by linking staff bonuses to FSA’s success in 
meeting its strategic goals. Despite the gains FSA has made in these areas, 
certain challenges remain. For example, FSA’s human capital senior 
manager has not been an active participant in setting FSA’s strategic 
direction — as have the heads of units managing its other key resources. 
Human capital challenges include the need to engage in workforce 
planning and to assess the training needs of staff. Moreover, FSA has not 
yet been able to implement a performance management system that 
creates goals for the performance of employees, groups, and the 
organization consistent with its performance plan as required by its 
enabling legislation. 

Education continues to take steps to clarify FSA’s level of independence 
and its relationship with other Education offices while long term 
management plans are being developed. With the arrival of the current 
administration, in January 2001, Education established special interim 
operating procedures for all department units, including FSA, that were 
intended to ensure that personnel and financial resources are managed 
effectively and efficiently throughout the department. As a result of these 
interim procedures, Education now provides greater direction and 
oversight of FSA than was provided previously. Education is currently 
reviewing FSA’s role and responsibilities as part of the departmentwide 
management planning effort. The results of this planning effort will be 
used to guide future decisions concerning FSA’s level of independence and 
its relationship to other department offices. Education expects to 
complete its review by Summer 2002. 

In this report, we recommend that the secretary of education direct FSA, 
in collaboration with the secretary, to make its performance plan more 
useful to congressional decision makers in the areas of unit cost, systems 
integration and program integrity, that the secretary of education and 
FSA’s chief operating officer (COO) work cooperatively to ensure that 
annual reports on the performance of the PBO are submitted to Congress 
in a timely and complete fashion, and that the secretary of education and 



0 State and private nonprofit guaranty agencies act as agents of the federal government, 
providing a variety of services, including payment of defaulted loans, collection of some 
defaulted loans, default-avoidance activities, and counseling to schools and students. 
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FSA’s COO coordinate closely to develop and implement a comprehensive 
human capital strategy. 

We provided Education with a copy of our draft report for review and 
comment. In written comments on our draft report, Education agreed with 
our reported findings and recommendations. Education’s written 
comments appear in appendix I. 



Background 



FSA manages and administers student financial assistance programs 
authorized under title IV of the Higher Education Act of 1965 (HEA), as 
amended. These postsecondary programs include the William D. Ford 
Federal Direct Loan Program (often referred to as the “Direct Loan”), the 
Federal Family Education Loan Program (often referred to as the 
“Guaranteed Loan”), the Federal Pell Grant Program, and campus-based 
programs. 7 Annually, these programs provide more than $50 billion in 
student aid to approximately 8 million students and their families. As a 
consequence, the student financial aid environment is large and complex. 
It involves about 5,300 schools authorized to participate in the title IV 
program, 4,100 lenders, and 36 guaranty agencies. Currently, FSA oversees 
or directly manages approximately $200 billion in outstanding loans 
representing about 100 million borrowers. 

Congress has recognized the need to make federal agencies more results- 
oriented by shifting from a focus on adherence to required processes to a 
focus on achieving program results and customer satisfaction. Toward this 
end, Congress established PBOs, which are discrete management units 
remaining in their current department under the policy guidance of the 
department secretary. PBOs are to commit to clear management 
objectives and specific targets for improved performance. These clearly 
defined performance goals, coupled with flexibility in managing 
operations and direct ties between the achievement of performance goals 
and the pay and tenure of the head of the PBO and other senior managers 
are intended to lead to improved performance. 

In October 1998, Congress established FSA as the government’s first PBO. 
As defined in the legislation, the specific purposes of the PBO are to 



7 Campus-based programs, which include the Federal Work-Study Program, the Federal 
Perkins Loan Program, and the Federal Supplemental Educational Opportunity Grant 
Program, are administered jointly by FSA and postsecondary institutions. 
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• improve service in the student financial assistance programs; 

• reduce costs of administering the programs; 

• increase accountability of officials; 

• provide a greater flexibility in management; 

• integrate information systems; 

• implement an open, common, integrated delivery system; and 

• develop and maintain a system containing complete, accurate and timely 
data to ensure program integrity. 

FSA’s enabling legislation also, among other things, 

• requires the appointment of a chief operating officer; 

• requires the development of 5-year and annual performance plans; 

• requires the PBO, through the secretary, to report annually on the 
performance of the PBO; 

• requires the PBO to have performance agreements for the COO and other 
senior managers; 

• requires the COO in consultation with the secretary to appoint a student 
loan ombudsman; 

• allows for the payment of performance bonuses to the COO and other 
senior managers; 

• allows FSA to make use of certain personnel and procurement 
flexibilities. 

We have reported on selected agencies’ use of performance agreements, 
including FSA, the Department of Transportation, and the Veterans Health 
Administration. Although these three agencies developed and 
implemented agreements that reflected their specific organizational 
priorities, structures and cultures, we identified five common emerging 
benefits from each agency’s use of the agreements. These emerging 
benefits include: strengthened alignments of results-oriented goals with 
daily operations, collaboration across organizational boundaries, 
enhanced opportunities to discuss and routinely use performance 
information to make program improvements, results-oriented basis for 
individual accountability, and continuity of program goals during 
leadership transitions. 8 

In addition to FSA, other PBOs include the U.S. Patent and Trademark 
Office (USPTO), established as a PBO in March 2000, and the Federal 



8 U.S. General Accounting Office, Managing for Results: Emerging Benefits from Selected 
Agencies' Use of Performance Agreements, GAO-Ol-115 (Washington, D.C.: Oct. 30, 2000). 
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Aviation Administration’s Air Traffic Organization (ATO), in December 
2000. Similar to FSA, USPTO, and ATO are subject to the policy direction 
of their parent departments and are to have the flexibility and 
independence to operate more like a business, with greater autonomy over 
their budget, hiring, and procurements in carrying out their functions. 
Further, USPTO and ATO are also required to designate an individual 
responsible for operational improvements, develop multiyear and annual 
performance plans, implement performance agreements, and provide for 
performance bonuses. 

The British Next Steps initiative was used as a model in crafting the PBO 
concept in the United States. The Next Steps agencies— now known as 
executive agencies — are still the predominant form of service delivery in 
the United Kingdom. As of December 2001, there were over 130 executive 
agencies covering more than three-quarters of the British civil service. 


FSA Has Taken Steps 
to Develop and 
Implement a Strategic 
Direction but 
Additional Actions 
Needed 


FSA has taken several steps toward developing and implementing a 
strategic direction — its plan for achieving the purposes Congress specified 
for it in the PBO legislation — but, even though these efforts have shown 
promising results, additional actions are needed. FSA’s performance plan 
discusses its three strategic goals — increase customer and employee 
satisfaction while decreasing unit cost — and the annual goals and 
strategies it will use to accomplish these three goals. The performance 
plan, however, could be more useful to congressional decision makers 
with respect to systems integration and program integrity. FSA has also 
begun to implement a balanced scorecard — a report that links employees’ 
day-to-day activities with the organization’s progress toward its strategic 
goals, but even with the scorecard, some employees have found it difficult 
to make this link. Finally, FSA and the department have not met its 
requirement to report annually to Congress on its progress in meeting the 
goals laid out in its performance plan, along with other requirements 
specified in the PBO legislation. 


FSA Has Three Strategic 
Goals Addressing 
Important Outcomes 


FSA’s performance plan discusses strategic goals for increasing customer 
and employee satisfaction and reducing unit costs. In addition, it includes 
measures for gauging FSA progress in meeting each of these strategic 
goals. (See table 1.) FSA’s management uses these goals and associated 
performance measures to determine areas for quality improvement, 
monitor changes in customer perceptions, and evaluate the success of 
ongoing quality improvement efforts in its student aid delivery. 
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Table 1: Strategic Goal Measurements and Reported Results 



Reported Results 



Strategic 

Goals 


Measurement 

instrument 


What the instrument measures 


FY 1999 


FY 2000 


FY 2001 


Increasing 

customer 

satisfaction 


American Customer 
Satisfaction Index 
(ACSI) 0 


Customers’ perception of overall service quality; their 
prior expectations; staff accessibility, professionalism, 
helpfulness, and timeliness; and the degree of 
customer complaints 


63 b 


72.9 


74.2 


Increasing 

employee 

satisfaction 


Gallup Q12 c 


Employees’ overall job satisfaction, their degree of 
loyalty and productivity, whether they know what is 
expected of them, whether they have opportunities to 
develop job skills, and whether they received 
encouragement and feel valued at FSA 


N/A 


3.51 


3.74 


Reducing unit 
cost 


FSA Calculation* 


The cost per loan and/or grant recipient to administer 
the student financial aid program. 


$18.72 


$19.08 


$19.57 



“ACSI measures customer satisfaction for public and private sector organizations and is produced by 
a partnership of the University of Michigan Business School, the American Society for Quality, and 
the CFI Group. The highest possible score on the index is 100. 



‘The score for fiscal year 1999 measured only one element of customer satisfaction. 

The Gallup Q12 is a 12-question survey instrument, designed by the Gallup Organization, to 
measure employee engagement for private and public sector organizations. Scores range from 1-5, 
with 5 being the highest. 

d FSA’s method of calculating unit cost changed in fiscal year 2001 . See the accompanying text for a 
more detailed discussion of the change. 

Source: FSA. 



To measure customer and employee satisfaction, FSA uses the American 
Customer Satisfaction Index (ACSI) and the Gallup Q12, respectively. Both 
measures are used by the private sector and other government entities, 
and, as a result, FSA can compare its own scores with those of others. 
FSA’s scores on both the ACSI and Gallup Q12 increased from fiscal year 
1999 through fiscal year 2001, suggesting improvement in both areas. 
Indeed, comments from representatives from several higher education 
associations we interviewed and who work closely with FSA also suggest 
that customer satisfaction has improved. For example, an association 
official noted the willingness of FSA managers to listen and learn from 
students, schools, and lending institutions. 

To track reductions in costs, FSA has developed a unit cost measure. FSA 
uses the measure to demonstrate how it is reducing the cost of 
administering the student aid programs. However, FSA’s current 
calculation has some limitations in this regard. First, in calculating unit 
cost, FSA divides budget obligations (an obligation reserves funds for an 
eventual cash payment for goods and services) by the total number of 
people who received aid. This means that FSA’s unit cost does not 
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measure costs, per se. 9 Further, the unit cost calculation does not include 
obligations FSA sees as beyond its control — obligations for services 
shared with the department (e.g., telecommunications) and obligations 
associated with loan consolidation, which is influenced by demand, for 
example. Obligations FSA considers as fully under its control include 
those for salaries and benefits, operations and modernization contracts, 
and general operations, such as travel, training, printing, and equipment. 
This means that unit cost does not measure total obligations per person 
receiving aid. Second, the way FSA currently calculates unit cost is a 
change from the way it calculated it in the past. This change makes 
comparing unit cost across years difficult. In 1998 through 2000, FSA 
calculated unit cost by dividing the actual cost (those it considered under 
its control) of administering student aid (instead of budget obligations) by 
the total number of people who had received aid. According to FSA 
officials, FSA changed the calculation of unit cost to make it more useful 
as a management tool, in part because actual costs for a particular year are 
sometimes not known until well into the next fiscal year and because 
managers are more accustomed to using budget obligations, in part 
because of their experience in using obligations in budget formulation and 
execution. Using actual cost in the calculation, the unit cost in fiscal year 
2000 was $19.08. When FSA recalculated unit cost for fiscal year 2000 
using budget obligations instead, the amount changed to $20. 14. 

FSA officials told us that they believe the unit cost measure is a useful tool 
for internal management information purposes, allowing managers to 
gauge the efficiency of their operations and to highlight, for its employees, 
the importance of reducing costs. Although these are important objectives, 
FSA’s unit cost measure is less useful to congressional decision makers 
because, among other things, FSA does not include all program obligations 
in the measure nor explain the basis of its measure in reporting on its 
performance. According to the Federal Accounting Standards Advisory 
Board (FASAB), decision makers in Congress as well as the public should 



9 According to the Statements of Federal Financial Accounting Concepts and Standards 
(SFFACS), Appendix E: Consolidated Glossary, full cost refers to the total amount of 
resources used to produce the output. More specifically, the full cost of an output 
produced by a responsibility segment is the sum of (1) the costs of resources consumed by 
the responsibility segment that directly or indirectly contribute to the output, and (2) the 
costs of identifiable supporting services provided by other responsibility segments within 
the reporting entity and by other reporting entities (SFFAS No. 4. Managerial Cost 
Accounting Concepts and Standards for the Federal Government, para. 89) According to 
OMB Circular No. A-25 Revised, full cost includes all direct and indirect costs to any part 
of the federal government of providing a good, resource, or service. 
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